﻿ INTERLINKING AND EXTENDING LARGE LEXICAL RESOURCES FOR ROMANIAN MIHAI ALEX MORUZ1,2, ANDREI SCUTELNICU1,2, AND DAN CRISTEA1,2 1 Faculty of Computer Science, “Alexandru Ioan Cuza” University of Iași 2 Institute for Computer Science, Romanian Academy, Iași branch {mmoruz, andreis, dcristea}@info uaic ro Abstract CoRoLa – the Representative Corpus of the Romanian language – was developed during a period of 4 years, and is available since 2017 At this moment it contains almost one billion Romanian words, covering a wide variety of domains (politics, humanities, theology, sciences, etc ) and all literary genres (fiction, poetry, theatre plays, scientific texts, journalistic texts, etc ) The raw texts are tokenized, lemmatized, and morphologically processed This paper describes two main research directions for the extension and improvement of CoRoLa The first issue discussed is the adding of new layers of annotation, such as noun and verb groups, syntactic trees, and some semantic information Secondly, we describe an interoperability standard for textual and lexical resources for Romanian (such as an wordnet and a dictionary) which opens the way for an efficient coupling of these resources, with the benefit of a much more diverse display about the use of the Romanian language Key words — CoRoLa, lexical resources, wordnet, electronic dictionary, textual linked data 1 Introduction Linguists around the world are deeply preoccupied to build linguistic resources that best describe languages and their structure, starting with simple collections of scanned documents, as in virtual libraries, to text collections organised as corpora, dictionaries and thesauri Linguistic resources are the primary ingredients fuelling the constant and relentless concern of researchers to study languages as they are or in their evolution, as well as to facilitate the automation of language processing technologies, so much needed today by the web and mobile industries Isolated, each linguistic resource was thought to fulfil some specific needs, but, very recently, the benefits of exploiting them interlinked has become evident (McCrae et al , 2011; Navigli and Ponzetto, 2012) For instance, to name only the domain of language learning, lexical resources are very important tools, structured in many ways: word lists, corpora, dictionary entries, wordnet synsets, language models, etc In this study, we will concentrate on three types of resources, each with a different structure, showing a proposal of interlinking them and some experiments: • RoWN – The Romanian WordNet (Tufiş and Cristea, 2002; Tufiș et al , 2013) is created following the model of the Princeton WordNet (Fellbaum, 1998), which can be considered a real revolution in computational linguistics through the scientific advances it has generated in recent years It is a collection of nouns, MIHAI ALEX MORUZ, ANDREI SCUTELNICU, AND DAN CRISTEA verbs, adjectives, and adverbs placed in a graph, where the nodes, called synsets, are sets of literals of the same syntactic category for which there are contexts in which they can be considered synonyms The literals, members of synsets, are paired with indexes denoting specific senses and one literal-sense pair can be member of only one synset Thus, each synset expresses a distinct linguistic concept and it can be seen in semantic relations with other synsets of the graph For instance, synsets of nouns and verbs are placed in a conceptual hierarchy through hypernymy and/or hyponymy relationships As shown in Figure 1, RoWordNet synsets have unique identifiers, which point to synsets of the English WordNet, considered the backbone of a whole network of different languages wordnets Figure 1: A RoWN entry • CoRoLa (the COrpus of contemporary ROmanian LAnguage) is a resource completed at the end of 2017, as a result of a team work of approximately 4 years, contributed by two institutes of the Romanian Academy: the Research Institute for Artificial Intelligence in Bucharest and the Institute of Computer Science in Iași At this moment, CoRoLa includes texts that sum up almost 1 billion Romanian words from a wide range of fields (politics, humanities, theology, sciences, arts, etc ) and covers all genres (literature, poetry, theatre, scientific texts, journalism, blogs) (Bibiri et al , 2015) The texts were obtained, on the basis of written protocols, from their IPR owners (publishing houses, bloggers, independent writers), and were passed through a processing chain (partially manual, partially automatic) along which the UTF-8 cleaned raw texts INTERLINKING AND EXTENDING LARGE LEXICAL RESOURCES FOR ROMANIAN were extracted, metadata was filled in and an XML annotation that includes tokens, lemmas and part of speeches was added (Tufiș and Ion, 2017) • eDTLR, the electronic form of the Thesaurus Dictionary of the Romanian Language (Cristea et al , 2011), is the searchable digital form of the largest and most complete Romanian dictionary, elaborated by the Romanian Academy in about one century and covering the Romanian language in diachronicity, from its first written origins to the contemporary usage The entries of this resource are partitioned in a hierarchy of senses, from main to very specific For each sense and sub-sense of the title word, its part of speech (POS), definition and examples of usage are selected from the approx 4,000 bibliographical sources, in chronological order (see Figure 2) All three described resources (RoWN, CoRoLa, eDTLR) are open freely for online access, but their XML formats are available on the basis of restricted licenses of use, which address precisely the community of (computational) linguists Figure 2: eDTLR dictionary entries 2 Indexing eDTLR and RoWN in CoRoLa 2 1 Pre-processing the resources In eDTLR, the complexity of the entries vary widely, they do not have a predefined size, i e an exact number of definitions and examples, because the number of senses and sub-senses is very different Fig 2 displays extracts from the XML representation of two words, one with a very rich tree of senses, with many different definitions and with more citations for each sense, and one with a very simple structure, including only information about POS and synonyms Another problem encountered in extracting the indexing information from eDTLR was the presence of accent on exactly one character of each title word The accents are intended to make explicit the correct pronunciation of the word (e g "VIOÁRĂ", with an accented "A") Since accented characters have different codes than their corresponding un-accented ones, we doubled each original title word with a variant in MIHAI ALEX MORUZ, ANDREI SCUTELNICU, AND DAN CRISTEA which the accented letter was automatically replaced by the un-accented one As such, eDTLR could be easily indexed at the title word level in view of allowing search operations over them, with the retrieved forms always being their accented variants Compared to eDTLR, both CoRoLa and RoWN have a compact structure, observing a well-defined template, which makes easier both information extraction and processing 2 2 Correspondence files A first step in indexing the resources was to extract the information relevant to their alignment Thus, a first indexing is done at the input word and their corresponding part of speech levels In order to index eDTLR and RoWN in CoRoLa, we first extracted all lemmas in the CoRoLa documents, and then we merged them, obtaining a list of unique pairs, containing lemma and part of speech We have also extracted lists of title words in eDTLR, together with the attached morphological descriptions for the entry and a list containing RoWN literals, their part of speech and the ILI code identifying the synset the literals belong to Having these lists available, we have created a correspondence file as follows: • match the lemma of a CoRoLa word to the entries in eDTLR and the literals in RoWN sysnsets; • refine the match on the basis of the identified POS for the corpus word, the morphological definition for the eDTLR entry and the POS of the RoWN synset The information is written in a correspondence file that contains POS of the corpus word, the lemma, the eDTLR file name that contains the entry, and the corresponding words in RoWN, as can be seen in Fig 3 Many lexical tokens in the corpus have correspondences in both eDTLR and RoWN, but there are also words that correspond only to one of the two resources or to none of them This is because the three lexical resources do not cover identical time periods, showing once more that the language is in a continuous process of change, is a true "living organism" with a spectacular evolution With this correspondence file available, in order to help researchers of the Romanian language, we have created a web interface in which the user can choose the desired associated resources and which dynamically displays pairings The left side window shows a fragment from a CoRoLa document file, while the right side one displays entries on one of the associated resources When the user is hovering over a word in the left window, the interface brings in the right window an entry of the other two resources The created links are based on the correspondences mentioned above As stated already, not every word in the corpus has a connection with elements from the other resources assigned, which makes that only part of the left hand side words be active Fig 4 shows the functionality of the interface Currently, this interface can only input a CoRoLa file, which is matched against eDTLR and/or RoWN, but we intend to develop the application to allow for multiple file processing and for word searches in the CoRoLa corpus that generate text snippets related to that word (somehow similar to the KoRAP key-word-in-context interface) INTERLINKING AND EXTENDING LARGE LEXICAL RESOURCES FOR ROMANIAN Figure 3: Correspondence file for the three resources Figure 4: Web interface for correspondences between CoRoLa – eDTLR and CoRoLa – RoWN Here it is exemplified a CoRoLa – eDTLR pairing A problem encountered in making the correspondence file is that the number of single lemmas is very large and the access time for this file is slow We have tested the system over a set of one hundred thousand files, for which the total number of words exceeds three hundred million, of which about one million eight hundred thousand of unique lemmas has been identified As a necessity in future, it would be ideal to make one MIHAI ALEX MORUZ, ANDREI SCUTELNICU, AND DAN CRISTEA correspondence file for each entry in the CoRoLa corpus, which would help optimize the search for connectivity between resources A second approach to indexing resources would be from the reverse perspective, namely, indexing the eDTLR and RoWN in the CoRoLa corpus The approach does not differ much from the previous indexing, namely, we keep the lists described in the previous step, only that now there will be two, one for each resource, as correspondence files Thus, for both eDTLR and RoWN we will do a similar verification, first matching head words and then refining with the POS Figure 5: Correspondence file between eDTLR and CoRoLa The resulting information is written in a correspondence file containing the POS of the input word from eDTLR, the input word and the name of the input file containing the eDTLR entry, and, from the CoRoLa corpus, contexts related to the search word This can also be seen in Fig 5, where contexts of 9 words are displayed, i e the search element is surrounded by four words before and four words after The length of the preceding and succeeding windows can be easily altered, although in most situations a 9-words window is sufficient for providing adequate context overview A similar process was carried out for the RoWN to CoRoLa correspondence, but instead of the name of the eDTLR file containing the dictionary entry, RoWN ILI code for the INTERLINKING AND EXTENDING LARGE LEXICAL RESOURCES FOR ROMANIAN corresponding synset was used For this approach, we have not yet developed any user interface 3 Indexing eDTLR in RoWN In order to extend the coverage of the lexical resources mentioned (eDTLR and RoWN), we also investigated some ways in which to link the senses of words in the thesaurus to synsets in RoWN This encumbers a sense disambiguation problem and for that we try to match eDTLR glosses against RoWN senses The problem encountered in eDTLR sense glosses is the complexity of entries Complexity is given by the variable number of senses and sub-senses of the input word, to which general and specific definitions with examples are added As can be seen in Fig 2, sense tree complexity varies largely, and it is this complexity which makes it difficult to analyse and extract the necessary information in the process of comparing definitions We have extracted from eDTLR lists containing: the entry name, a list with all the definitions extracted from the tag and the POS For the RoWN, a similar list was created for each synset The match function used is as follows: if edtlrList[POS] = rownList[POS] and edtlrList[entry] = rownList[literal] then return the match between glosses by counting the number of common words, normalized to We ran this function on the three eDTLR entries for “VIOARĂ”, one of which is an adjective and the others nouns (the name of a plant and the musical instrument) In RoWN, the literal “VIOARĂ” is present twice, with the sense of musical instrument (one modern, and another archaic) In the first phase, applying the above described matching test, we only leave two of the three eDTLR entries, namely the nouns In the second step, for the entry describing the plant, the algorithm identified, for all sense definitions 1-2% matches, since it referred to common words such as “care”, “de”, “cu” For the second word, describing the musical instrument, we have three distinct senses, of which the first sense is further partitioned into 14 sub-senses After analysing the results, we found that the definition in RoWN pertaining to the musical instrument is 100% matched to one of the first-sense definitions in eDTLR, and the one referring to the archaic instrument only has a 55 55% match with the same definition This is explained by the fact that: some RoWN sense definitions originated in Dex Online; which in turn is based on definitions from DEX, which has as a main resource the DLR thesaurus 4 Conclusions In this paper we have described a method for the alignment of three lexical resources for Romanian, eDTLR, RoWN and CoRoLa, at the word level, which allows users to access them in a common interface We have also investigated a manner in which existing lexical resources can be enriched and linked at the sense level, as an aid for future attempts at word sense disambiguation for the Romanian language We intend to further investigate ways in which lexical resources such as eDTLR and RoWN can be further linked at the sense level with greater accuracy, and thus attempt to propose new synsets or to extend existing ones MIHAI ALEX MORUZ, ANDREI SCUTELNICU, AND DAN CRISTEA Acknowledgements This study was partially supported by a grant of the Romanian Ministry of Research and Innovation, CCCDI – UEFISCDI, project number PN-III-P1-1 2-PCCDI-2017-0818 / 73PCCDI (ReTeRom) References Bibiri, A D , Bolea, C D , Scutelnicu, L A , Moruz, A , Pistol, L , Cristea, D (2015) Metadata of a Huge Corpus of Contemporary Romanian Data and organization of the work, in Proceedings of the 7th Balkan Conference in Informatics ACM New York ISBN 978-1-4503-3335-1 Chiarcos C , McCrae J , Cimiano P , Fellbaum C (2013) Towards Open Data for Linguistics: Linguistic Linked Data In: Oltramari A , Vossen P , Qin L , Hovy E (eds ) New Trends of Research in Ontologies and Lexical Resources Theory and Applications of Natural Language Processing Springer, Berlin, Heidelberg Cristea, D , Haja, G , Moruz, A , Răschip, M , Pătrașcu, M I (2011) Partial statistics at the end of the eDTLR project – the Thesaurus Dictionary of the Romanian Language in electronic form (Statistici parțiale la încheierea proiectului eDTLR – Dicționarul Tezaur al Limbii Române în format electronic) In R Zafiu, C Ușurelu, H Bogdan Oprea (eds ) Romanian language Hypostasis of linguistic variation Acts of the 10th Colloquium of the Chair of Romanian Language (Limba română Ipostaze ale variației lingvistice Actele celui de-al 10-lea Colocviu al Catedrei de limba română), Bucharest, 3-4 December, vol I: Grammar and phonology, lexicon, semantics, terminology, history of Romanian language, dialectology and philology (Gramatică şi fonologie, lexic, semantică, terminologie, istoria limbii române, dialectologie şi filologie), Bucharest University Editing House, p 213-224, ISBN 978-606-16-0046-5 Fellbaum, C (ed ) (1998) WordNet: An Electronic Lexical Database, Cambridge, MA, Mit Press, 1998 McCrae J , Spohr D , Cimiano P (2011) Linking Lexical Resources and Ontologies on the Semantic Web with Lemon In: Antoniou G et al (eds ) The Semantic Web: Research and Applications ESWC 2011 Lecture Notes in Computer Science, vol 6643 Springer, Berlin, Heidelberg Navigli, T and Ponzetto, S (2012) BabelNet: The Automatic Construction, Evaluation and Application of a Wide-Coverage Multilingual Semantic Network Artificial Intelligence, 193, Elsevier, 2012, pp 217-250 Tufiș, D , Cristea, D (2002) Methodological issues in building the Romanian Wordnet and consistency checks in Balkanet, in Proceedings of the Workshop on Wordnet Structures and Standardization, and how these affect Wordnet Applications and Evaluation, in conjunction with the Third International Conference on Language Resources and Evaluation (LREC), 28-31 May, Las Palmas, Spain, p 35-41 Tufiș, D , Barbu Mititelu, V , Ștefănescu, D , Ion, R (2013) The Romanian Wordnet in a Nutshell In Language Resources and Evaluation, vol 47, p 1305-1314 Tufiș, D , Ion, R (2017) Part of Speech Tagging In R Mitkov (ed ) The Oxford Handbook of Computational Linguistics, Oxford University Press, 2nd edition 